A Multimodal Approach to Communicative Interactivity Classification

نویسندگان

  • Tomasz M. Rutkowski
  • Danilo P. Mandic
  • Allan Kardec Barros
چکیده

The problem of modality detection in so called communicative interactivity is addressed. Multiple audio and video recordings of human communication are analyzed within this framework, based on fusion of the extracted features. At the decision level, support vector machines (SVMs) are utilized to segregate between the communication modalities. The proposed approach is verified through simulations on real world recordings.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

ISLE Natural Interactivity and Multimodality Working Group Deliverable D11.2 Requirements Specification for a Tool in Support of Annotation of Natural Interaction and Multimodal Data

for dissemination) This report discusses overall functionality, interface, architecture and platform requirements to a toolset in support of transcription, annotation, information extraction and analysis of natural and multimodal interaction (NIMM) data. NIMM data are corpora of recorded audio and/or visual data from natural and/or multimodal human-human and/or human-system communicative intera...

متن کامل

Dybkjaer, L., Berman, S., Bernsen, N. O., Carletta, J., Heid, U., & Llisterri, J. (2001). Requirements and specifications for a tool in support of annotation of natural interaction and multimodal data.

for dissemination) This report discusses overall functionality, interface, architecture and platform requirements to a toolset in support of transcription, annotation, information extraction and analysis of natural and multimodal interaction (NIMM) data. NIMM data are corpora of recorded audio and/or visual data from natural and/or multimodal human-human and/or human-system communicative intera...

متن کامل

Aesthetic Symbolic and Communicative Functions of English Signs in Urban Spaces of Jordan: Typography, Multimodality, and Ideological Values

This study examines the visual aesthetic function of English signs in line with ethnographic approaches as a means of achieving various symbolic and communicative implications in the linguistic landscape (LL) of Jordan. Having coded the data in 6 urban streets of the major Jordanian cities, the social semiotic analysis centers on the visual layout of signs based on the typographical features of...

متن کامل

A Multidimensional Approach to Multimodal Dialogue Act Annotation

This paper investigates the benefits of multidimensional approaches to dialogue act annotation, and the advantages of using layered multidimensional ’open’ dialogue act taxonomies. We performed a comparative analysis of a one-dimensional and two multidimensional dialogue act annotation schemes, and concluded that not only does a multidimensional approach support a more accurate analysis of huma...

متن کامل

A Multimodal Approach toward Teaching for Transfer: A Case of Team-Teaching in ESAP Writing Courses

This paper presents a detailed examination of learning transfer from an English for Specific Academic Purposes course to authentic discipline-specific writing tasks. To enhance transfer practices, a new approach in planning writing tasks and materials selection was developed. Concerning the conventions of studies in learning transfer that acknowledge different learning preferences, the instruct...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • VLSI Signal Processing

دوره 49  شماره 

صفحات  -

تاریخ انتشار 2007